Skip to content

mtcollins1 runner: dispatch floor to ephemeral slot + collect instruments (leg 3) - #13640

Closed
gunbai-bot[bot] wants to merge 3 commits into
mainfrom
session/quiet-cat-583
Closed

gunbai-bot[bot] wants to merge 3 commits into
mainfrom
session/quiet-cat-583

Conversation

@gunbai-bot

@gunbai-bot gunbai-bot Bot commented Oct 9, 2026

Copy link
Copy Markdown
Contributor

Auto-opened by session-dashboard for session quiet-cat-583.
Pushing to session/quiet-cat-583 advances this PR.

Worker attestation

Before flipping this PR to ready for review, confirm each item:

  • Title describes the change (not the session id or branch).
  • PR body summarises what and why (replace the TODO below).
  • Tests run: name the command (e.g. npm test, cargo test) and the result.
  • If this closes a work item, the body contains a Closes #N directive.
  • No commits on this branch are surprises (no fork/cherry-pick I did not make).
  • No secrets / credentials / large binaries staged.

Summary

TODO: replace this paragraph with one or two sentences naming the change and its motivation. Reviewers read this first.

Test plan

  • TODO: list the commands that ran (or "no tests changed; relied on CI") and the outcome.

@briansrls
briansrls marked this pull request as ready for review October 9, 2026 17:36
@chatgpt-codex-connector

chatgpt-codex-connector Bot commented Oct 9, 2026 •

Copy link
Copy Markdown

Codex Review Summary

This comment shows the latest Codex review activity on this pull request.

Review Status Commit Review trigger
📝 Code Review ✅ Completed 2026-10-09T20:14:57.023231Z aefd8e7 Draft marked ready
ℹ️ About Codex in GitHub

Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you

  • Open a pull request for review
  • Mark a draft as ready
  • Comment "@codex review" or "@codex security review".

Codex reacts with 👀 while any review is running, comments if it has suggestions, and reacts with 👍 once all reviews finish with no findings.

@chatgpt-codex-connector chatgpt-codex-connector Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

💡 Codex Review

Here are some automated review suggestions for this pull request.

Reviewed commit: aefd8e7268

ℹ️ About Codex in GitHub

Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you

  • Open a pull request for review
  • Mark a draft as ready
  • Comment "@codex review".

If Codex has suggestions, it will comment; otherwise it will react with 👍.

Codex can also answer questions or update the PR. Try commenting "@codex address that feedback".

Comment on lines +172 to +174
match job.runner_name {
Present { value: n } =>
if n == (expected.value as String) { none } else {

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

P2 Badge Check the minted runner ID during readback

When a JIT registration is deleted and recreated under the same runner name, such as when retrying the same attempt, this name-only comparison accepts the replacement even though the job did not run on the registration represented by the dispatch receipt. QualificationDispatchPlan already preserves the minted runner_id, and GitHub's workflow-job response exposes runner_id, so model and compare that value as well; otherwise measurements can be attributed to the wrong ephemeral slot. GitHub workflow-job response schema

Useful? React with 👍 / 👎.

Comment on lines +255 to +257
InstrumentInRunArtifact { name: n } =>
match artifacts |> filter(a => a.name == (n as String) && !a.expired) |> first {
Present { value: a } => InstrumentCollected { instrument: instrument, reading: InstrumentArtifactListed { artifact: a } }

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

P2 Badge Download the claim-cost artifact before marking it collected

For ClaimCostArtifactEvalSteps, this branch returns only list-entry metadata (id, name, size, and expiry) and marks the instrument collected; it never retrieves the archive containing required_floor_claim_cost.tsv. The route describes this instrument as eval-step data parsed by parse_claim_cost_tsv, but no later consumer can obtain those bytes from InstrumentArtifactListed; GitHub exposes artifact contents through a separate download endpoint, so the archive must be downloaded/extracted or the result must remain uncollected. GitHub artifact download endpoint

Useful? React with 👍 / 👎.

@gunbai-bot
gunbai-bot Bot marked this pull request as draft October 9, 2026 17:50
@briansrls
briansrls marked this pull request as ready for review October 9, 2026 20:11

@chatgpt-codex-connector chatgpt-codex-connector Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

💡 Codex Review

Here are some automated review suggestions for this pull request.

Reviewed commit: aefd8e7268

ℹ️ About Codex in GitHub

Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you

  • Open a pull request for review
  • Mark a draft as ready
  • Comment "@codex review".

If Codex has suggestions, it will comment; otherwise it will react with 👍.

Codex can also answer questions or update the PR. Try commenting "@codex address that feedback".

Comment on lines +139 to +140
ref: p.target.branch as String,
inputs: qualification_dispatch_inputs(attempt: p.attempt),

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

P2 Badge Bind dispatch to the pinned workload revision

When FloorWorkloadPin.revision differs from the current tip of this branch—or the branch advances before dispatch—the route runs the wrong corpus because the dispatch sends only the mutable branch and the attempt label; the workload pin carried by DispatchFloorToSlot never reaches this plan. GitHub's endpoint selects a branch/tag through ref and accepts workflow-specific values through inputs (Create a workflow dispatch event), so the qualification workflow needs the pinned revision as an input and must check out that exact SHA (with readback bound to it). Otherwise the later subject join may reject the measurement, but only after consuming the ephemeral registration without ever running the requested experiment.

Useful? React with 👍 / 👎.

@gunbai-bot

gunbai-bot Bot commented Oct 9, 2026

Copy link
Copy Markdown
Contributor Author

Closed without folding in the v1 closeout bankruptcy (#13641). A superseded WIP flush (quiet-cat-583). The branch is kept for archaeology; no follow-up obligation is created. — sent from neat-wolf-604

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

0 participants